Image correction using individual manipulation of microlenses in a microlens array

ABSTRACT

A system constructs a composite image using focus assessment information of image regions.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is related to and claims the benefit of theearliest available effective filing date(s) from the following listedapplication(s) (the “Related Applications”) (e.g., claims earliestavailable priority dates for other than provisional patent applicationsor claims benefits under 35 USC § 119(e) for provisional patentapplications, for any and all parent, grandparent, great-grandparent,etc. applications of the Related Application(s)), and incorporates byreference in its entirety all subject matter of the following listedapplication(s) (the “Related Applications”); the present applicationalso claims the earliest available effective filing date(s) from, andalso incorporates by reference in its entirety all subject matter of anyand all parent, grandparent, great-grandparent, etc. applications of theRelated Application(s) to the extent such subject matter is notinconsistent herewith. The United States Patent Office (USPTO) haspublished a notice to the effect that the USPTO's computer programsrequire that patent applicants reference both a serial number andindicate whether an application is a continuation or continuation inpart. Stephen G. Kunin, Benefit of Prior-Filed Application, USPTOOfficial Gazette Mar. 18, 2003. The present Applicant entity(hereinafter “Applicant”) has provided below a specific reference to theapplication(s) from which priority is being claimed as recited bystatute. Applicant understands that the statute is unambiguous in itsspecific reference language and does not require either a serial numberor any characterization such as “continuation” or “continuation-in-part”for claiming priority to U.S. patent applications. Notwithstanding theforegoing, Applicant understands that the USPTO's computer programs havecertain data entry requirements, and hence Applicant is designating thepresent application as a continuation in part of its parent applicationsas set forth below, but expressly points out that such designations arenot to be construed in any way as any type of commentary and/oradmission as to whether or not the present application contains any newmatter in addition to the matter of its parent application(s).

All subject matter of the Related Applications and of any and allparent, grandparent, great-grandparent, etc. applications of the RelatedApplications is incorporated herein by reference to the extent suchsubject matter is not inconsistent herewith.

Related Application(s):

1. For purposes of the USPTO extra-statutory requirements, the presentapplication constitutes a continuation in part of currently co-pendingUnited States patent application entitled LENS DEFECT CORRECTION, U.S.application Ser. No. 10/738,626, now U.S. Pat. No. 7,231,097, namingWilliam D. Hillis, Nathan P. Myhrvold, and Lowell L. Wood Jr. asinventors, filed 16 Dec. 2003, which is currently co-pending, or is anapplication of which a currently co-pending application is entitled tothe benefit of the filing date.2. For purposes of the USPTO extra-statutory requirements, the presentapplication constitutes a continuation in part of currently co-pendingUnited States patent application entitled IMAGE CORRECTION USINGMICROLENS ARRAY AS A UNIT, U.S. application Ser. No. 10/764,340, nowU.S. Pat. No. 7,251,078, naming William D. Hillis, Nathan P. Myhrvold,and Lowell L. Wood Jr. as inventors, filed 21 Jan. 2004, which iscurrently co-pending, or is an application of which a currentlyco-pending application is entitled to the benefit of the filing date.3. For purposes of the USPTO extra-statutory requirements, the presentapplication constitutes a continuation-in-part of U.S. patentapplication Ser. No. 10/764,431, now U.S. Pat. No. 6,967,780, entitledIMAGE CORRECTION USING INDIVIDUAL MANIPULATION OF MICROLENSES IN AMICROLENS ARRAY, naming W. Daniel Hillis; Nathan P. Myhrvold; and LowellL. Wood, Jr. as inventors, filed 21 Jan. 2004, which is currentlyco-pending, or is an application of which a currently co-pendingapplication is entitled to the benefit of the filing date.4. For purposes of the USPTO extra-statutory requirements, the presentapplication constitutes a continuation-in-part of U.S. patentapplication Ser. No. 11/221,350, now U.S. Pat. No. 7,417,797 entitledIMAGE CORRECTION USING INDIVIDUAL MANIPULATION OF MICROLENSES IN AMICROLENS ARRAY, naming W. Daniel Hillis; Nathan P. Myhrvold; and LowellL. Wood, Jr. as inventors, filed 7 Sep. 2005, which is currentlyco-pending, or is an application of which a currently co-pendingapplication is entitled to the benefit of the filing date.5. For purposes of the USPTO extra-statutory requirements, the presentapplication constitutes a continuation-in-part of U.S. patentapplication Ser. No. 11/498,427, now U.S. Pat. No. 7,259,917 entitledIMAGE CORRECTION USING A MICROLENS ARRAY AS A UNIT, naming W. DanielHillis; Nathan P. Myhrvold; and Lowell L. Wood, Jr. as inventors, filed2 Aug. 2006, which is currently co-pending, or is an application ofwhich a currently co-pending application is entitled to the benefit ofthe filing date.6. For purposes of the USPTO extra-statutory requirements, the presentapplication constitutes a continuation-in-part of U.S. patentapplication Ser. No. 11/804,314, entitled LENS DEFECT CORRECTION, namingW. Daniel Hillis; Nathan P. Myhrvold; and Lowell L. Wood, Jr. asinventors, filed 15 May 2007, which is currently co-pending, or is anapplication of which a currently co-pending application is entitled tothe benefit of the filing date.7. For purposes of the USPTO extra-statutory requirements, the presentapplication constitutes a continuation-in-part of U.S. patentapplication Ser. No. 11/811,356, now U.S. Pat. No. 7,742,233, entitledIMAGE CORRECTION USING MICROLENS ARRAY AS A UNIT, naming W. DanielHillis; Nathan P. Myhrvold; and Lowell L. Wood, Jr. as inventors, filed7 Jun. 2007, which is currently co-pending, or is an application ofwhich a currently co-pending application is entitled to the benefit ofthe filing date.8. For purposes of the USPTO extra-statutory requirements, the presentapplication constitutes a continuation-in-part of U.S. patentapplication Ser. No. 12/072,497, entitled IMAGE CORRECTION USINGINDIVIDUAL MANIPULATION OF MICROLENSES IN A MICROLENS ARRAY, naming W.Daniel Hillis; Nathan P. Myhrvold; and Lowell L. Wood, Jr. as inventors,filed 25 Feb. 2008, which is currently co-pending, or is an applicationof which a currently co-pending application is entitled to the benefitof the filing date.

TECHNICAL FIELD

The present application relates, in general, to imaging.

SUMMARY

In one aspect, a method includes but is not limited to: capturing aprimary image with a microlens array at a primary position, themicrolens array having at least one microlens deviation that exceeds afirst tolerance from a target optical property; determining at least oneout-of-focus region of the primary image; capturing another image withat least one microlens of the microlens array at another position;determining a focus of at least one region of the other image relativeto a focus of the at least one out-of-focus region of the primary image;and constructing a composite image in response to the at least oneregion of the other image having a sharper focus relative to the focusof the at least one out-of-focus region of the primary image. Inaddition to the foregoing, other method embodiments are described in theclaims, drawings, and text forming a part of the present application. Inaddition to the foregoing, other method aspects are described in theclaims, drawings, and text forming a part of the present application.

In one or more various aspects, related systems include but are notlimited to machinery and/or circuitry and/or programming for effectingthe herein-referenced method aspects; the machinery and/or circuitryand/or programming can be virtually any combination of hardware,software, and/or firmware configured to effect the foregoing-referencedmethod aspects depending upon the design choices of the system designer.

In one aspect, a system includes but is not limited to: a photo-detectorarray; a microlens array having at least one microlens deviation thatexceeds a first tolerance from a target optical property; a controllerconfigured to position at least one microlens of the microlens array ata primary and another position relative to the photo-detector array andto cause an image capture signal at the primary and the other position;and an image construction unit configured to construct at least oneout-of-focus region of a first image captured at the primary positionwith a more in-focus region of another image captured at the otherposition. In addition to the foregoing, other system aspects aredescribed in the claims, drawings, and text forming a part of thepresent application.

In one aspect, a system includes but is not limited to: a microlensarray having at least one microlens deviation that exceeds a firsttolerance from a target optical property; an electro-mechanical systemconfigurable to capture a primary image with at least one microlens ofthe microlens array at a primary position said electro-mechanical systemincluding at least one of electrical circuitry operably coupled with atransducer, electrical circuitry having at least one discrete electricalcircuit, electrical circuitry having at least one integrated circuit,electrical circuitry having at least one application specific integratedcircuit, electrical circuitry having a general purpose computing deviceconfigured by a computer program, electrical circuitry having a memorydevice, and electrical circuitry having a communications device; anelectro-mechanical system configurable to capture another image with theat last one microlens of the microlens array at another position saidelectro-mechanical system including at least one of electrical circuitryoperably coupled with a transducer, electrical circuitry having at leastone discrete electrical circuit, electrical circuitry having at leastone integrated circuit, electrical circuitry having at least oneapplication specific integrated circuit, electrical circuitry having ageneral purpose computing device configured by a computer program,electrical circuitry having a memory device, and electrical circuitryhaving a communications device; an electro-mechanical systemconfigurable to determine at least one out-of-focus region of theprimary image said electro-mechanical system including at least one ofelectrical circuitry operably coupled with a transducer, electricalcircuitry having at least one discrete electrical circuit, electricalcircuitry having at least one integrated circuit, electrical circuitryhaving at least one application specific integrated circuit, electricalcircuitry having a general purpose computing device configured by acomputer program, electrical circuitry having a memory device, andelectrical circuitry having a communications device; anelectro-mechanical system configurable to determine a focus of at leastone region of the other image relative to a focus of the at least oneout-of-focus region of the primary image said electro-mechanical systemincluding at least one of electrical circuitry operably coupled with atransducer, electrical circuitry having at least one discrete electricalcircuit, electrical circuitry having at least one integrated circuit,electrical circuitry having at least one application specific integratedcircuit, electrical circuitry having a general purpose computing deviceconfigured by a computer program, electrical circuitry having a memorydevice, and electrical circuitry having a communications device; anelectro-mechanical system configurable to determine a focus of at leastone region of the other image relative to a focus of the at least oneout-of-focus region of the primary image said electro-mechanical systemincluding at least one of electrical circuitry operably coupled with atransducer, electrical circuitry having at least one discrete electricalcircuit, electrical circuitry having at least one integrated circuit,electrical circuitry having at least one application specific integratedcircuit, electrical circuitry having a general purpose computing deviceconfigured by a computer program, electrical circuitry having a memorydevice, and electrical circuitry having a communications device; and anelectro-mechanical system configurable to construct a composite image inresponse to the at least one region of the other image having a sharperfocus relative to the focus of the at least one out-of-focus region ofthe primary image said electro-mechanical system including at least oneof electrical circuitry operably coupled with a transducer, electricalcircuitry having at least one discrete electrical circuit, electricalcircuitry having at least one integrated circuit, electrical circuitryhaving at least one application specific integrated circuit, electricalcircuitry having a general purpose computing device configured by acomputer program, electrical circuitry having a memory device, andelectrical circuitry having a communications device. In addition to theforegoing, other system aspects are described in the claims, drawings,and text forming a part of the present application.

In one aspect, a method includes but is not limited to: capturing aprimary image with a microlens array at a primary position, saidcapturing effected with a photo-detector array having an imaging surfacedeviation that exceeds a first tolerance from a target surface position;determining at least one out-of-focus region of the primary image;capturing another image with at least one microlens of the microlensarray at another position; determining a focus of at least one region ofthe other image relative to a focus of the at least one out-of-focusregion of the primary image; and constructing a composite image inresponse to the at least one region of the other image having a sharperfocus relative to the focus of the at least one out-of-focus region ofthe primary image. In addition to the foregoing, other method aspectsare described in the claims, drawings, and text forming a part of thepresent application.

In one embodiment, a method includes but is not limited to: capturing aprimary image with a lens at a primary position, the lens having atleast one deviation that exceeds a first tolerance from a target opticalproperty; capturing another image with the lens at another position;determining at least one out-of-focus region of the primary image;determining a focus of at least one region of the other image relativeto a focus of the at least one out-of-focus region of the primary image;and constructing a composite image in response to the at least oneregion of the other image having a sharper focus relative to the focusof the at least one out-of-focus region of the primary image. Inaddition to the foregoing, various other method embodiments are setforth and described in the text (e.g., claims and/or detaileddescription) and/or drawings of the present application.

In one or more various embodiments, related systems include but are notlimited to electro-mechanical systems (e.g., motors, actuators,circuitry, and/or programming) for effecting the herein-referencedmethod embodiments); the electrical circuitry can be virtually anycombination of hardware, software, and/or firmware configured to effectthe foregoing-referenced method embodiments depending upon the designchoices of the system designer.

In one embodiment, a system includes but is not limited to: aphoto-detector array; a lens having at least one deviation that exceedsa first tolerance from a target optical property; a controllerconfigured to position said lens at a primary and another positionrelative to said photo-detector array and to cause an image capturesignal at the primary and the other position; and an image constructionunit configured to construct at least one out-of-focus region of a firstimage captured at the primary position with a more in-focus region ofanother image captured at the other position.

In one aspect, a method includes but is not limited to: capturing aprimary image with a microlens array at a primary position, themicrolens array having at least one microlens deviation that exceeds afirst tolerance from a target optical property; determining at least oneout-of-focus region of the primary image; capturing another image withthe microlens array at another position; determining a focus of at leastone region of the other image relative to a focus of the at least oneout-of-focus region of the primary image; and constructing a compositeimage in response to the at least one region of the other image having asharper focus relative to the focus of the at least one out-of-focusregion of the primary image. In addition to the foregoing, other methodaspects are described in the claims, drawings, and text forming a partof the present application.

In one or more various aspects, related systems include but are notlimited to machinery and/or circuitry and/or programming for effectingthe herein-referenced method aspects; the machinery and/or circuitryand/or programming can be virtually any combination of hardware,software, and/or firmware configured to effect the foregoing-referencedmethod aspects depending upon the design choices of the system designer.

In one aspect, a system includes but is not limited to: a microlensarray having at least one microlens deviation that exceeds a firsttolerance from a target optical property; means for capturing a primaryimage with a lens at a primary position; means for determining at leastone out-of-focus region of the primary image; means for capturinganother image with the lens at another position; means for determining afocus of at least one region of the other image relative to a focus ofthe at least one out-of-focus region of the primary image; and means forconstructing a composite image in response to the at least one region ofthe other image having a sharper focus relative to the focus of the atleast one out-of-focus region of the primary image. In addition to theforegoing, other system aspects are described in the claims, drawings,and text forming a part of the present application.

In one aspect, a system includes but is not limited to: a microlensarray having at least one microlens deviation that exceeds a firsttolerance from a target optical property; an electro-mechanical systemconfigurable to capture a primary image with the microlens array at aprimary position said electro-mechanical system including at least oneof electrical circuitry operably coupled with a transducer, electricalcircuitry having at least one discrete electrical circuit, electricalcircuitry having at least one integrated circuit, electrical circuitryhaving at least one application specific integrated circuit, electricalcircuitry having a general purpose computing device configured by acomputer program, electrical circuitry having a memory device, andelectrical circuitry having a communications device; anelectro-mechanical system configurable to capture another image with themicrolens array at another position said electro-mechanical systemincluding at least one of electrical circuitry operably coupled with atransducer, electrical circuitry having at least one discrete electricalcircuit, electrical circuitry having at least one integrated circuit,electrical circuitry having at least one application specific integratedcircuit, electrical circuitry having a general purpose computing deviceconfigured by a computer program, electrical circuitry having a memorydevice, and electrical circuitry having a communications device; anelectro-mechanical system configurable to determine at least oneout-of-focus region of the primary image said electro-mechanical systemincluding at least one of electrical circuitry operably coupled with atransducer, electrical circuitry having at least one discrete electricalcircuit, electrical circuitry having at least one integrated circuit,electrical circuitry having at least one application specific integratedcircuit, electrical circuitry having a general purpose computing deviceconfigured by a computer program, electrical circuitry having a memorydevice, and electrical circuitry having a communications device; anelectro-mechanical system configurable to determine a focus of at leastone region of the other image relative to a focus of the at least oneout-of-focus region of the primary image said electro-mechanical systemincluding at least one of electrical circuitry operably coupled with atransducer, electrical circuitry having at least one discrete electricalcircuit, electrical circuitry having at least one integrated circuit,electrical circuitry having at least one application specific integratedcircuit, electrical circuitry having a general purpose computing deviceconfigured by a computer program, electrical circuitry having a memorydevice, and electrical circuitry having a communications device; anelectro-mechanical system configurable to determine a focus of at leastone region of the other image relative to a focus of the at least oneout-of-focus region of the primary image said electro-mechanical systemincluding at least one of electrical circuitry operably coupled with atransducer, electrical circuitry having at least one discrete electricalcircuit, electrical circuitry having at least one integrated circuit,electrical circuitry having at least one application specific integratedcircuit, electrical circuitry having a general purpose computing deviceconfigured by a computer program, electrical circuitry having a memorydevice, and electrical circuitry having a communications device; and anelectro-mechanical system configurable to construct a composite image inresponse to the at least one region of the other image having a sharperfocus relative to the focus of the at least one out-of-focus region ofthe primary image said electro-mechanical system including at least oneof electrical circuitry operably coupled with a transducer, electricalcircuitry having at least one discrete electrical circuit, electricalcircuitry having at least one integrated circuit, electrical circuitryhaving at least one application specific integrated circuit, electricalcircuitry having a general purpose computing device configured by acomputer program, electrical circuitry having a memory device, andelectrical circuitry having a communications device. In addition to theforegoing, other system aspects are described in the claims, drawings,and text forming a part of the present application.

In one aspect, a method includes but is not limited to: capturing aprimary image with a microlens array at a primary position, saidcapturing effected with a photo-detector array having an imaging surfacedeviation that exceeds a first tolerance from a target surface position;determining at least one out-of-focus region of the primary image;capturing another image with the microlens array at another position;determining a focus of at least one region of the other image relativeto a focus of the at least one out-of-focus region of the primary image;and constructing a composite image in response to the at least oneregion of the other image having a sharper focus relative to the focusof the at least one out-of-focus region of the primary image. Inaddition to the foregoing, other method aspects are described in theclaims, drawings, and text forming a part of the present application.

In addition to the foregoing, various other method and/or system aspectsare set forth and described in the text (e.g., claims and/or detaileddescription) and/or drawings of the present application.

The foregoing is a summary and thus contains, by necessity;simplifications, generalizations and omissions of detail; consequently,those skilled in the art will appreciate that the summary isillustrative only and is NOT intended to be in any way limiting. Otheraspects, inventive features, and advantages of the devices and/orprocesses described herein, as defined solely by the claims, will becomeapparent in the non-limiting detailed description set forth herein.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 shows a front-plan view of image 100 of a person (e.g., person202 of FIG. 2) projected onto photo-detector array 102.

FIG. 2 depicts a side-plan view of lens system 200 that can give rise toimage 100 of FIG. 1.

FIG. 3 depicts a high level logic flowchart of a process.

FIG. 4 depicts a side-plan view of the system of FIG. 2 whereinmicrolens array 204 has been moved in accordance with aspects of theprocess shown and described in relation to FIG. 3.

FIG. 5 illustrates another side-plan view of the system of FIG. 2wherein microlens array 204 has been moved in accordance with aspects ofthe process shown and described in relation to FIG. 3.

FIG. 1A shows a front-plan view of image 100A of a person (e.g., person202A of FIG. 2A) projected onto photo-detector array 102A.

FIG. 2A depicts a side-plan view of lens system 200A that can give riseto image 100A of FIG. 1A.

FIG. 3A depicts a high level logic flowchart of a process.

FIG. 4A depicts a side-plan view of the system of FIG. 2A wherein lens204A has been moved in accordance with aspects of the process shown anddescribed in relation to FIG. 3A.

FIG. 5A illustrates another side-plan view of the system of FIG. 2Awherein lens 204A has been moved in accordance with aspects of theprocess shown and described in relation to FIG. 3A.

FIG. 1B shows a front-plan view of image 100B of a person (e.g., person202B of FIG. 2B) projected onto photo-detector array 102B.

FIG. 2B depicts a side-plan view of lens system 200B that can give riseto image 100B of FIG. 1B.

FIG. 3B depicts a high level logic flowchart of a process.

FIG. 4B depicts a side-plan view of the system of FIG. 2B whereinmicrolens array 204B has been moved in accordance with aspects of theprocess shown and described in relation to FIG. 3B.

FIG. 5B illustrates another side-plan view of the system of FIG. 2Bwherein microlens array 204B has been moved in accordance with aspectsof the process shown and described in relation to FIG. 3B.

The use of the same symbols in different drawings typically indicatessimilar or identical items.

DETAILED DESCRIPTION

With reference to the figures, and with reference now to FIG. 1, shownis a front-plan view of image 100 of a person (e.g., person 202 of FIG.2) projected onto photo-detector array 102. Image 100 is shown asdistorted due to defects in a microlens array through which image 100has been projected (e.g., microlens array 204 of lens system 200 of FIG.2). First portion 104 of image 100 is illustrated as large and blurry,which can occur when a microlens deviation causes first portion 104 ofimage 100 to come to a focus in front of a surface of photo-detectorarray 102. Second, third, and fourth portions 106 of image 100 areillustrated as right sized, which can occur when microlenses of themicrolens array cause portions 106 to correctly focus on an imagingsurface of photo-detector array 102. Fifth portion 108 of image 100 isshown as small and faint, which can occur when a microlens deviationcauses fifth portion 108 to come to a focus (virtual) behind an imagingsurface of photo-detector array 102. In addition, although not expresslyshown, those having skill in the art will appreciate that variousmicrolens defects could also cause the image to be distorted in x-y;those having skill in the art will also appreciate that differentcolored wavelengths of light can in and of themselves focus at differentpositions due to differences in refraction of the different coloredwavelengths of light. In addition, although not expressly shown herein,those having skill in the art will appreciate that the subject matterdisclosed herein may serve to remedy misfocusings/distortions arisingfrom defects other than lens defects, such as, for example, defects inthe imaging surface of photo-detector array 102 and/or defects in framesthat hold microlens arrays.

Referring now to FIG. 2, depicted is a side-plan view of lens system 200that can give rise to image 100 of FIG. 1. Microlens array 204 of lenssystem 200 is illustrated as located at a primary position and havingmicrolens deviations that give rise to the five different portions ofimage 100 shown and described in relation to FIG. 1. First portion 104of image 100 is illustrated as misfocused in front of an imaging surfaceof photo-detector array 102, where the misfocusing is due to a deviationof microlens 252. Second, third, and fourth portions 106 of image 100are illustrated as respectively right sized and focused by microlenses250, 254, and 258 on an imaging surface of photo-detector array 102. (Itis recognized that in side plan view the head and feet of person 202would appear as lines; however, for sake of clarity they are shown inprofile in FIG. 2 to help orient the reader relative to FIG. 1.) Fifthportion 108 is shown as small and faint, and (virtually) misfocusedbehind an imaging surface of photo-detector array 102, where themisfocusing is due to a deviation of microlens 256. In addition,although not expressly shown herein, those having skill in the art willappreciate that the subject matter of FIG. 2 is also illustrative ofthose situations in which one or more individual photo-detectors formingpart of the imaging surface of photo-detector array 102—rather than oneor more microlenses of microlens array 204—deviate from one or morepredefined positions by amounts such that image misfocuses/distortionsarising from such deviations are unacceptable. That is, insofar as imagemisfocusing or distortion could just as easily arise from photo-detectorarray 102 having mispositioned photo-detectors as from microlens array204 having mispositioned/defective lenses, the subject matter disclosedherein may serve to remedy misfocusings/distortions arising from defectsin the imaging surface of photo-detector array 102.

Continuing to refer to FIG. 2, further shown are components that canserve as an environment for the process shown and described in relationto FIG. 3. Specifically, controller 208 is depicted as controlling theposition of the various microlenses 250-258 of microlens array 204 oflens system 200 (e.g., via use of one or more feedback controlsubsystems). Image capture unit 206 is illustrated as receiving imagedata from photo-detector array 102 and receiving control signals fromcontroller 208. Image capture unit 206 is shown as transmitting capturedimage information to focus detection unit 210. Focus detection unit 210is depicted as transmitting focus data to image construction unit 212.Image construction unit 212 is illustrated as transmitting a compositeimage to image store/display unit 214.

With reference now to FIG. 3, depicted is a high level logic flowchartof a process. Method step 300 shows the start of the process. Methodstep 302 depicts capturing a primary image with a microlens array havingone or more microlenses at one or more primary positions, the microlensarray having at least one microlens deviation that exceeds a firsttolerance from a target optical property. Examples of the array havingat least one microlens deviation that exceeds a first tolerance from atarget optical property include (a) where at least one actual microlensposition exceeds a first tolerance from at least one defined microlensposition, and (b) where at least one microlens of the microlens arrayhas at least one focal length that exceeds a first tolerance from adefined focal length (e.g., a microlens deviation that would producefifth portion 108 of image 100 at some place behind an imaging surfaceof photo-detector array 102 or a microlens deviation that would produceportion 104 at some place in front of the imaging surface ofphoto-detector array 102 where the distance in front or back of theimaging surface exceeds a defined tolerance distance where an imagecaptured with photo-detector array 102 is deemed acceptable). Specificinstances of the foregoing include a microlens of the microlens arrayhaving at least one spherical aberration that exceeds a first tolerancefrom a defined spherical aberration, and a microlens of the microlensarray having at least one cylindrical aberration that exceeds a firsttolerance from a defined cylindrical aberration. Alternatively, themicrolens array may have one or more microlenses having some combinationof such defects. In one implementation, method step 302 includes thesub-step of capturing the primary image at an average primary focalsurface location of the microlens array (e.g., a defined focal surfaceof the microlens array where an image would form if the microlens arrayhad no microlenses having aberrations outside a specified tolerance). Inanother implementation, method step 302 includes the sub-step ofcapturing the primary image with a photo-detector array at the averageprimary focal surface location of the microlens array (e.g., positioningthe microlens array such that a defined focal surface of the microlensarray coincides with an imaging surface of a photo-detector array).

Referring again to FIG. 2, one specific example of method step 302 (FIG.3) would be controller 208 directing lens system 200 to position one ormore microlenses of microlens array 204 at one or more primarypositions, and thereafter instructing image capture unit 206 to capturean image from photo-detector array 102.

With reference again to FIG. 3, method step 304 illustrates determiningat least one out-of-focus region of the primary image (or determining atleast one focused region of the primary image). In one implementation,method step 304 includes the sub-step of calculating a Fourier transformof at least a part of the primary image (e.g., sharp, or in-focus imagesproduce abrupt transitions that often have significant high frequencycomponents).

Referring again to FIG. 2, one specific example of method step 304 (FIG.3) would be focus detection unit 210 performing a Fourier transform andsubsequent analysis on at least a part of an image captured by imagecapture unit 206 when the one or more microlenses of microlens array 204were at the one or more primary positions. In this example, focusdetection unit 210 could deem portions of the image having significanthigh frequency components as “in focus” images. As a more specificexample, the Fourier transform and analysis may be performed on one ormore parts of the image that are associated with one or more microlenses250-258 of microlens array 204.

With reference again to FIG. 3, method step 305 illustrates mapping theat least one out-of-focus region to one or more microlenses of themicrolens array. In one implementation, method step 305 includes thesub-steps of projecting mathematically from a surface of aphoto-detector to the microlens array; and selecting one or moremicrolenses of the microlens array in response to said projecting.

Referring again to FIG. 2, one specific example of method step 305 (FIG.3) would be controller 208 performing a mathematical mapping based on(a) known geometries of microlenses 250-258 relative to photo-detectorarray 102 and (b) focus/out-of-focus information received from focusdetection unit 210. In one exemplary implementation, controller 208 ispre-programmed with knowledge of the position/orientation ofphoto-detector array 102 and can thus calculate the mathematicalprojection based on controller 208′s positioning of microlenses 250-258.In other exemplary implementations, controller 208 additionally controlsand/or monitors the positioning of photo-detector array 102 through oneor more control and/or monitoring subsystems, and thus hasacquired—rather than pre-programmed—knowledge of theposition/orientation of photo-detector array 102 upon which to base thecalculations.

With reference again to FIG. 3, method step 306 illustrates moving atleast a part of the mapped one or more microlenses of the microlensarray to one or more other positions.

Referring again to FIG. 2, one specific example of method step 306 (FIG.3) would be controller 208 causing a control subsystem of lens system200 to move one or more individual microlenses 250-258 of microlensarray 204. In one exemplary implementation, MEMS control systems andtechniques are used. In other exemplary implementations, conventionalcontrol systems and techniques are used to effect the movement andcontrol of microlenses 250-258 of microlens array 204.

With reference again to FIG. 3, method step 307 shows capturing anotherimage with the one or more microlenses at the other positions to whichthey have been moved. In one exemplary implementation, method step 306includes the sub-step of capturing the other image at the averageprimary focal surface location of the microlens array with itsindividual microlenses at their primary positions (e.g., one or moremicrolenses 250-258 of microlens array 204 are moved, but the image iscaptured on about the same surface as that upon which the primary imagewas captured, such as shown and described in relation to FIGS. 4 and 5).In another exemplary implementation, the step of capturing the otherimage at a primary focal surface location of the microlens array withits individual microlenses at their primary positions further includesthe sub-steps of moving at least a part of the microlens array (e.g., atleast one microlens) to the other position; and capturing the otherimage with a photo-detector array which remains stationary at theprimary focal surface location of the one or more microlenses at theirone or more primary positions (e.g., one or more microlenses 250-258 ofmicrolens array 204 are moved to one or more other positions, whilephoto-detector array 102 remains stationary, such as shown and describedin relation to FIGS. 4 and 5). In another exemplary implementation, thestep of moving at least a part of the microlens array to the otherposition further includes the sub-step of moving the at least a part ofthe microlens array to the other position within at least one distanceconstrained by a predefined aberration from at least one definedmicrolens position.

Referring now to FIGS. 2, 4 and/or 5, one specific example of methodstep 306 (FIG. 3) would be controller 208 directing lens system 200 toposition one or more of microlenses 250-258 of microlens array 204 atone or more positions other than their primary positions, and thereafterinstructing image capture unit 206 to capture an image fromphoto-detector array 102. FIG. 4 shows and describes moving at least aportion of microlens array 204 forward of a primary position (e.g., suchas by controller 208 causing a MEMS control system to move microlens 256of microlens array 204 forward relative to an imaging surface ofphoto-detector array 102, or by causing microlens array 204 to becompressed such that microlens 256 of microlens array 204 moves forwardrelative to the imaging surface of photo-detector array 102). FIG. 5shows and describes moving at least a portion of the microlens arrayrearward of the primary position (e.g., such as by controller 208causing a MEMS control system to move microlens 252 of microlens array204 rearward relative to an imaging surface of photo-detector array 102,or by causing microlens array 204 to be compressed such that microlens252 of microlens array 204 moves rearward relative to an imaging surfaceof photo-detector array 102).

With reference again to FIG. 3, method step 308 depicts determining afocus of at least one region of the other image relative to a focus ofthe at least one out-of-focus region of the primary image. In oneimplementation, method step 308 includes the sub-step of calculating aFourier transform of at least a part of at least one region of the otherimage (e.g., sharp or in-focus images produce abrupt transitions thatoften have significant high frequency components). In oneimplementation, the step of calculating a Fourier transform of at leasta part of at least one region of the other image (e.g., sharp orin-focus images produce abrupt transitions that often have significanthigh frequency components) includes the sub-step of mapping at least oneregion of the primary image with at least one region of the other image(e.g., mapping an out-of-focus region of the first image to acorresponding region of the second image). As a more specific example,the Fourier transform and analysis may be performed on one or more partsof the image that are associated with one or more microlenses of themicrolens array (e.g., mapping at least one region of the primary imageassociated with at least one specific microlens against the at least oneregion of the other image associated with the at least one specificmicrolens).

Referring again to FIGS. 2, 4 and/or 5, one specific example of methodstep 308 (FIG. 3) would be focus detection unit 210 performing a Fouriertransform and subsequent analysis on at least a part of an imagecaptured by image capture unit 206 when at least one microlens ofmicrolenses 250-258 of microlens array 204 was at the other positionspecified by controller 208.

With reference again to FIG. 3, method step 310 depicts constructing acomposite image in response to the at least one region of the otherimage having a sharper focus relative to the focus of the at least oneout-of-focus region of the primary image. In one implementation, thestep of constructing a composite image in response to the at least oneregion of the other image having a sharper focus relative to the focusof the at least one out-of-focus region of the primary image includesthe sub-step of replacing at least a part of the out-of-focus region ofthe primary image with at least a part of the at least one region of theother image. In yet another implementation, the step of constructing acomposite image in response to the at least one region of the otherimage having a sharper focus relative to the focus of the at least oneout-of-focus region of the primary image includes the sub-step ofutilizing at least one of tiling image processing techniques, morphingimage processing techniques, blending image processing techniques, andstitching image processing techniques.

In yet another implementation, the step of constructing a compositeimage in response to the at least one region of the other image having asharper focus relative to the focus of the at least one out-of-focusregion of the primary image includes the sub-steps of correlating afeature of the primary image with a feature of the other image;detecting at least one of size, color, and displacement distortion of atleast one of the primary image and the other image; correcting thedetected at least one of size, color, and displacement distortion of theat least one of the primary image and the other image; and assemblingthe composite image using the corrected distortion. In yet anotherimplementation, the step of constructing a composite image in responseto the at least one region of the other image having a sharper focusrelative to the focus of the at least one out-of-focus region of theprimary image includes the sub-step of correcting for motion between theprimary and the other image.

Referring again to FIGS. 2, 4 and/or 5, one specific example of methodstep 302 (FIG. 3) would be image construction unit 212 creating acomposite image by replacing those portions of an image of person 202captured at a primary position with more in-focus portions of an imageof person 202 captured by image capture unit 206 when microlens array204 was at the other position. In one implementation of the example,image construction unit 212 corrects for the motion between images usingconventional techniques if such correction is desired. In anotherimplementation of the example, motion correction is not used.

With reference again to FIG. 3, method step 312 shows a determination ofwhether an aggregate change in focus, relative to the primary positionof method step 302, has exceeded a maximum expected aberration of atleast one lens of the microlens array. For example, even with arelatively poor quality microlens array, there will typically be anupper manufacturing limit beyond which microlens aberrations are notexpected to go (e.g., the microlens array has manufacturing criteriasuch that each microlens in the array provide a focal length of 5mm+/−0.05 mm).

Referring again to FIGS. 2, 4 and/or 5, one specific example of methodstep 312 (FIG. 3) would be controller 208 comparing an aggregatemovement in a defined direction against a pre-stored upper limitdeviation value. In an implementation of the example illustrated in FIG.4, if microlens array 204 has manufacturing criteria such as a focallength of 5 mm+/−0.05 mm, controller 208 will determine whether thetotal forward movement of microlens 256 of microlens array 204 isgreater than 0.05 mm relative to microlens 256's primary position. In animplementation of the example illustrated in FIG. 5, if microlens array204 has manufacturing criteria such as a focal length of 5 mm+/−0.05 mm,controller 208 will determine whether the total rearward movement ofmicrolens 252 of microlens array 204 is greater than 0.05 mm relative tomicrolens 252's primary position.

With reference again to FIG. 3, if the inquiry of method step 312 yieldsa determination that the aggregate changes in focuses has met orexceeded the maximum expected aberration of at least one lens of themicrolens array, the process proceeds to method step 314. Method step314 illustrates that the current composite image (e.g., of method step310) is stored and/or displayed. One specific example of method step 314would be image store/display unit 214 either storing or displaying thecomposite image.

Method step 316 shows the end of the process.

Returning to method step 312, shown is that in the event that the upperlimit on microlens array tolerance of at least one lens of the microlensarray has not been met or exceeded, the process proceeds to method step306 and continues as described herein.

Referring now to FIG. 4, depicted is a side-plan view of the system ofFIG. 2 wherein microlens 256 has been moved in accordance with aspectsof the process shown and described in relation to FIG. 3. Microlens 256of lens system 200 is illustrated as having been moved to anotherposition forward of its primary position which gave rise to microlens256's respective portion of image 100 shown and described in relation toFIGS. 1 and 2. Specifically, microlens 256 of microlens array 204 isillustrated as repositioned such that fifth portion 108 of image 100 isright sized and focused on an imaging surface of photo-detector array102 (e.g., as shown and described in relation to method step 306). Inone implementation, fifth portion 108 of image 100 can be combined withpreviously captured in focus and right sized portions 106 (e.g., FIGS. 1and 2) to create a composite image such that the defects associated withfifth portion 108 as shown and described in relation to FIGS. 1 and 2are alleviated (e.g., as shown and described in relation to method step310). The remaining components and control aspects of the various partsof FIG. 4 function as described elsewhere herein.

With reference now to FIG. 5, illustrated is another side-plan view ofthe system of FIG. 2 wherein microlens 252 has been moved in accordancewith aspects of the process shown and described in relation to FIG. 3.Microlens 252 of lens system 200 is illustrated as having been moved toanother position rearward of its primary position which gave risemicrolens 252's respective portion of image 100 shown and described inrelation to FIG. 1. Specifically, microlens 252 of microlens array 204is illustrated as positioned such that first portion 104 of image 100 isright sized and focused on an imaging surface of photo-detector array102 (e.g., as described in relation to method step 306). In oneimplementation, first portion 104 of image 100 can be combined withpreviously captured in focus and right sized portions 106 of FIGS. 1 and2, 108 of FIG. 4) to create a composite image such that the defectsassociated with first portion 104 as shown and described in relation toFIGS. 1 and 2 are alleviated (e.g., as shown and described in relationto method step 310). The remaining components and control aspects of thevarious parts of FIG. 5 function as described elsewhere herein.

Those having skill in the art will recognize that the state of the arthas progressed to the point where there is little distinction leftbetween hardware and software implementations of aspects of systems; theuse of hardware or software is generally (but not always, in that incertain contexts the choice between hardware and software can becomesignificant) a design choice representing cost vs. efficiency tradeoffs.Those having skill in the art will appreciate that there are variousvehicles by which processes and/or systems described herein can beeffected (e.g., hardware, software, and/or firmware), and that thepreferred vehicle will vary with the context in which the processes aredeployed. For example, if an implementer determines that speed andaccuracy are paramount, the implementer may opt for a hardware and/orfirmware vehicle; alternatively, if flexibility is paramount, theimplementer may opt for a solely software implementation; or, yet againalternatively, the implementer may opt for some combination of hardware,software, and/or firmware. Hence, there are several possible vehicles bywhich the processes described herein may be effected, none of which isinherently superior to the other in that any vehicle to be utilized is achoice dependent upon the context in which the vehicle will be deployedand the specific concerns (e.g., speed, flexibility, or predictability)of the implementer, any of which may vary. Those skilled in the art willrecognize that optical aspects of implementations will requireoptically-oriented hardware, software, and or firmware.

The foregoing detailed description has set forth various embodiments ofthe devices and/or processes via the use of block diagrams, flowcharts,and examples. Insofar as such block diagrams, flowcharts, and examplescontain one or more functions and/or operations, it will be understoodas notorious by those within the art that each function and/or operationwithin such block diagrams, flowcharts, or examples can be implemented,individually and/or collectively, by a wide range of hardware, software,firmware, or virtually any combination thereof. In one embodiment, thepresent invention may be implemented via Application Specific IntegratedCircuits (ASICs), Field Programmable Gate Arrays (FPGAs), or otherintegrated formats. However, those skilled in the art will recognizethat the embodiments disclosed herein, in whole or in part, can beequivalently implemented in standard integrated circuits, as one or morecomputer programs running on one or more computers (e.g., as one or moreprograms running on one or more computer systems), as one or moreprograms running on one or more processors (e.g., as one or moreprograms running on one or more microprocessors), as firmware, or asvirtually any combination thereof, and that designing the circuitryand/or writing the code for the software and or firmware would be wellwithin the skill of one of skill in the art in light of this disclosure.In addition, those skilled in the art will appreciate that themechanisms of the present invention are capable of being distributed asa program product in a variety of forms, and that an illustrativeembodiment of the present invention applies equally regardless of theparticular type of signal bearing media used to actually carry out thedistribution. Examples of a signal bearing media include, but are notlimited to, the following: recordable type media such as floppy disks,hard disk drives, CD ROMs, digital tape, and computer memory; andtransmission type media such as digital and analog communication linksusing TDM or IP based communication links (e.g., packet links).

In a general sense, those skilled in the art will recognize that thevarious embodiments described herein which can be implemented,individually and/or collectively, by various types of electro-mechanicalsystems having a wide range of electrical components such as hardware,software, firmware, or virtually any combination thereof; and a widerange of components that may impart mechanical force or motion such asrigid bodies, spring or torsional bodies, hydraulics, andelectro-magnetically actuated devices, or virtually any combinationthereof. Consequently, as used herein “electro-mechanical system”includes, but is not limited to, electrical circuitry operably coupledwith a transducer (e.g., an actuator, a motor, a piezoelectric crystal,etc.), electrical circuitry having at least one discrete electricalcircuit, electrical circuitry having at least one integrated circuit,electrical circuitry having at least one application specific integratedcircuit, electrical circuitry forming a general purpose computing deviceconfigured by a computer program (e.g., a general purpose computerconfigured by a computer program which at least partially carries outprocesses and/or devices described herein, or a microprocessorconfigured by a computer program which at least partially carries outprocesses and/or devices described herein), electrical circuitry forminga memory device (e.g., forms of random access memory), electricalcircuitry forming a communications device (e.g., a modem, communicationsswitch, or optical-electrical equipment), and any non-electrical analogthereto, such as optical or other analogs. Those skilled in the art willalso appreciate that examples of electro-mechanical systems include butare not limited to a variety of consumer electronics systems, as well asother systems such as motorized transport systems, factory automationsystems, security systems, and communication/computing systems. Thoseskilled in the art will recognize that electro-mechanical as used hereinis not necessarily limited to a system that has both electrical andmechanical actuation except as context may dictate otherwise.

Those skilled in the art will recognize that it is common within the artto describe devices and/or processes in the fashion set forth herein,and thereafter use standard engineering practices to integrate suchdescribed devices and/or processes into image processing systems. Thatis, at least a portion of the devices and/or processes described hereincan be integrated into an image processing system via a reasonableamount of experimentation. Those having skill in the art will recognizethat a typical image processing system generally includes one or more ofa system unit housing, a video display device, a memory such as volatileand non-volatile memory, processors such as microprocessors and digitalsignal processors, computational entities such as operating systems,drivers, and applications programs, one or more interaction devices,such as a touch pad or screen, control systems including feedback loopsand control motors (e.g., feedback for sensing lens position and/orvelocity; control motors for moving/distorting lenses to give desiredfocuses. A typical image processing system may be implemented utilizingany suitable commercially available components, such as those typicallyfound in digital still systems and/or digital motion systems.

The foregoing described embodiments depict different componentscontained within, or connected with, different other components. It isto be understood that such depicted architectures are merely exemplary,and that in fact many other architectures can be implemented whichachieve the same functionality. In a conceptual sense, any arrangementof components to achieve the same functionality is effectively“associated” such that the desired functionality is achieved. Hence, anytwo components herein combined to achieve a particular functionality canbe seen as “associated with” each other such that the desiredfunctionality is achieved, irrespective of architectures or intermedialcomponents. Likewise, any two components so associated can also beviewed as being “operably connected” or “operably coupled” to each otherto achieve the desired functionality.

While particular embodiments of the present invention have been shownand described, it will be understood by those skilled in the art that,based upon the teachings herein, changes and modifications may be madewithout departing from this invention and its broader aspects and,therefore, the appended claims are to encompass within their scope allsuch changes and modifications as are within the true spirit and scopeof this invention. Furthermore, it is to be understood that theinvention is solely defined by the appended claims. It will beunderstood by those within the art that, in general, terms used herein,and especially in the appended claims (e.g., bodies of the appendedclaims) are generally intended as “open” terms (e.g., the term“including” should be interpreted as “including but not limited to,” theterm “having” should be interpreted as “having at least,” the term“includes” should be interpreted as “includes but is not limited to,”“comprise” and variations thereof, such as, “comprises” and “comprising”are to be construed in an open, inclusive sense, that is as “including,but not limited to,” etc.). It will be further understood by thosewithin the art that if a specific number of an introduced claimrecitation is intended, such an intent will be explicitly recited in theclaim, and in the absence of such recitation no such intent is present.For example, as an aid to understanding, the following appended claimsmay contain usage of the introductory phrases “at least one” and “one ormore” to introduce claim recitations. However, the use of such phrasesshould not be construed to imply that the introduction of a claimrecitation by the indefinite articles “a” or “an” limits any particularclaim containing such introduced claim recitation to inventionscontaining only one such recitation, even when the same claim includesthe introductory phrases “one or more” or “at least one” and indefinitearticles such as “a” or “an” (e.g., “a” and/or “an” should typically beinterpreted to mean “at least one” or “one or more”); the same holdstrue for the use of definite articles used to introduce claimrecitations. In addition, even if a specific number of an introducedclaim recitation is explicitly recited, those skilled in the art willrecognize that such recitation should typically be interpreted to meanat least the recited number (e.g., the bare recitation of “tworecitations,” without other modifiers, typically means at least tworecitations, or two or more recitations).

II. Lens Defect Correction

With reference to the figures, and with reference now to FIG. 1A, shownis a front-plan view of image 100A of a person (e.g., person 202A ofFIG. 2A) projected onto photo-detector array 102A. Image 100A is shownas distorted due to defects in a lens through which image 100A has beenprojected (e.g., lens 204A of lens system 200A of FIG. 2A). Firstportion 104A of image 100A is illustrated as large and blurry, which canoccur when a lens defect causes portion 104A of image 100A to come to afocus in front of a surface of photo-detector array 102A. Second, third,and fourth portions 106A are illustrated as right sized, which can occurwhen the lens causes portions 106A of image 100A to correctly focus onan imaging surface of photo-detector array 102A. Fifth portion 108A isshown as small and faint, which can occur when a lens defect causesportion 108A of image 100A to come to a focus (virtual) behind animaging surface of photo-detector array 102A. In addition, although notexpressly shown, those having skill in the art will appreciate thatvarious lens defects could also cause the image to be distorted in x-y;those having skill in the art will also appreciate that differentcolored wavelengths of light can in and of themselves focus at differentpositions due to differences in refraction of the different coloredwavelengths of light.

Referring now to FIG. 2A, depicted is a side-plan view of lens system200A that can give rise to image 100A of FIG. 1A. Lens 204A of lenssystem 200A is illustrated as located at a primary position and havingdefects that give rise to the five different portions of image 100Ashown and described in relation to FIG. 1A. First portion 104A of image100A is illustrated as focused in front of an imaging surface ofphoto-detector array 102A. Second, third, and fourth portions 106A areillustrated as right sized and focused on an imaging surface ofphoto-detector array 102A. (It is recognized that in side plan view thehead and feet of person 202A would appear as lines; however, for sake ofclarity they are shown in profile in FIG. 2A to help orient the readerrelative to FIG. 1A.) Fifth portion 108A is shown as small and faint,and virtually focused behind an imaging surface of photo-detector array102A.

Continuing to refer to FIG. 2A, further shown are components that canserve as the environment for the process shown and described in relationto FIG. 3A. Specifically, controller 208A is depicted as controlling theposition of lens 204A of lens system 200A (e.g., via use of a feedbackcontrol subsystem). Image capture unit 206A is illustrated as receivingimage data from photo-detector 102A and receiving control signals fromcontroller 208A. Image capture unit 206A is shown as transmittingcaptured image information to focus detection unit 210A. Focus detectionunit 210A is depicted as transmitting focus data to image constructionunit 212A. Image construction unit 212A is illustrated as transmitting acomposite image to image store/display unit 214A.

With reference now to FIG. 3A, depicted is a high level logic flowchartof a process. Method step 300A shows the start of the process. Methodstep 302A depicts capturing a primary image with a lens at a primaryposition, the lens having at least one deviation that exceeds a firsttolerance from a target optical property. One example of the lens havingat least one deviation that exceeds a first tolerance from a targetoptical property would be where the lens has at least one focal lengththat exceeds a first tolerance from a defined focal length (e.g., adefect that would produce portion 108A of image 100A at some placebehind an imaging surface of photo-detector 102A or a defect that wouldproduce portion 104A at some place in front of the imaging surface ofphoto-detector array 102A where the distance in front or back of theimaging surface exceeds a defined tolerance distance where an imagecaptured with the photo-detector array 102A is deemed acceptable). Forinstance, the lens may have at least one spherical aberration thatexceeds a first tolerance from a defined spherical aberration, or thelens may have at least one cylindrical aberration that exceeds a firsttolerance from a defined cylindrical aberration. Alternatively, the lensmay have some combination of such defects. In one implementation, methodstep 302A includes the sub-step of capturing the primary image at aprimary focal surface location of the lens (e.g., a defined focalsurface of the lens where an image would form if the lens had noaberrations). In another implementation, method step 302A includes thesub-step of capturing the primary image with a photo-detector array atthe primary focal surface location of the lens (e.g., positioning thelens such that a defined focal surface of the lens coincides with animaging surface of a photo-detector array).

Referring again to FIG. 2A, one specific example of method step 302A(FIG. 3A) would be controller 208A directing lens system 200A toposition lens 204A at a primary position, and thereafter instructingimage capture unit 100A to capture an image from photo-detector 102A.

With reference again to FIG. 3A, method step 304A illustratesdetermining at least one out-of-focus region of the primary image (ordetermining at least one focused region of the primary image). In oneimplementation, method step 304A includes the sub-step of calculating aFourier transform of at least a part of the primary image (e.g., sharp,or in-focus images produce abrupt transitions that often havesignificant high frequency components).

Referring again to FIG. 2A, one specific example of method step 304A(FIG. 3A) would be focus detection unit 210A performing a Fouriertransform and subsequent analysis on at least a part of an imagecaptured by image capture unit 206A when lens 204A was at the primaryposition. In this example, focus detection unit 210A could deem portionsof the image having significant high frequency components as “in focus”images.

With reference again to FIG. 3A, method step 306A shows capturinganother image with the lens at another position. In one implementation,method step 306A includes the sub-step of capturing the other image atthe primary focal surface location of the lens at the primary position(e.g., lens 204A is moved to another position, while photo-detector 102Aremains stationary, such as shown and described in relation to FIGS. 4Aand 5A). In another implementation, the step of capturing the otherimage at a primary focal surface location of the lens at the primaryposition further includes the sub-step of moving at least a part of thelens to the other position; and capturing the other image with aphoto-detector array at the primary focal surface location of the lensat the primary position. In another implementation, the step of movingat least a part of the lens to the other position further includes thesub-step of moving the at least a part of the lens to the other positionwithin at least one distance constrained by the first tolerance from thetarget optical property. In another implementation, the step of movingat least a part of the lens to the other position further includes thesub-step of moving an intermediary lens. In another implementation, thestep of moving at least a part of the lens to the other position furtherincludes the sub-step of distorting the lens such that the at least apart of the lens resides at the other position (e.g., a part of lens204A is moved to another position, such as might happen if lens 204Awere to be compressed laterally in a controlled manner, whilephoto-detector 102A remains stationary, such as shown and described inrelation to FIGS. 4A and 5A).

Referring now to FIGS. 2A, 4A and/or 5A, one specific example of methodstep 306A (FIG. 3A) would be controller 208A directing lens system 200Ato position lens 204A at a position other than the primary position andthereafter instructing image capture unit 100A to capture an image fromphoto-detector 102A. FIG. 4A shows and describes moving at least aportion of the lens forward of the primary position (e.g., such as bycontroller 208A moving lens 204A forward, or causing lens 204A to becompressed such that a part of lens 204A moves forward relative to animaging surface of photo-detector 102A). FIG. 5A shows and describesmoving at least a portion of the lens rearward of the primary position(e.g., such as by controller 208A moving lens 204A forward, or causinglens 204A to be compressed such that a part of lens 204A moves rearwardrelative to an imaging surface of photo-detector 102A).

With reference again to FIG. 3A, method step 308A depicts determining afocus of at least one region of the other image relative to a focus ofthe at least one out-of-focus region of the primary image. In oneimplementation, method step 310A includes the sub-step of calculating aFourier transform of at least a part of at least one region of the otherimage (e.g., sharp or in-focus images produce abrupt transitions thatoften have significant high frequency components). In oneimplementation, the step of calculating a Fourier transform of at leasta part of at least one region of the other image (e.g., sharp orin-focus images produce abrupt transitions that often have significanthigh frequency components) includes the sub-step of mapping at least oneregion of the primary image with at least one region of the other image(e.g., mapping an out-of-focus region of the first image to acorresponding region of the second image).

Referring again to FIGS. 2A, 4A and/or 5A, one specific example ofmethod step 302A (FIG. 3A) would be focus detection unit 210A performinga Fourier transform and subsequent analysis on at least a part of animage captured by image capture unit 206A when lens 204A was at theother position specified by controller 208A.

With reference again to FIG. 3A, method step 310A depicts constructing acomposite image in response to the at least one region of the otherimage having a sharper focus relative to the focus of the at least oneout-of-focus region of the primary image. In one implementation, thestep of constructing a composite image in response to the at least oneregion of the other image having a sharper focus relative to the focusof the at least one out-of-focus region of the primary image includesthe sub-step of replacing at least a part of the out-of-focus region ofthe primary image with at least a part of the at least one region of theother image. In another implementation, the step of constructing acomposite image in response to the at least one region of the otherimage having a sharper focus relative to the focus of the at least oneout-of-focus region of the primary image includes the sub-step ofreplacing at least a part of the out-of-focus region of the primaryimage with at least a part of the at least one region of the otherimage. In yet another implementation, the step of constructing acomposite image in response to the at least one region of the otherimage having a sharper focus relative to the focus of the at least oneout-of-focus region of the primary image includes the sub-step ofutilizing at least one of tiling image processing techniques, morphingimage processing techniques, blending image processing techniques, andstitching image processing techniques.

In yet another implementation, the step of constructing a compositeimage in response to the at least one region of the other image having asharper focus relative to the focus of the at least one out-of-focusregion of the primary image includes the sub-steps of correlating afeature of the primary image with a feature of the other image;detecting at least one of size, color, and displacement distortion of atleast one of the primary image and the other image; correcting thedetected at least one of size, color, and displacement distortion of theat least one of the primary image and the other image; and assemblingthe composite using the corrected distortion. In yet anotherimplementation, the step of constructing a composite image in responseto the at least one region of the other image having a sharper focusrelative to the focus of the at least one out-of-focus region of theprimary image includes the sub-step of correcting for motion between theprimary and the other image.

Referring again to FIGS. 2A, 4A and/or 5A, one specific example ofmethod step 302A (FIG. 3A) would be image construction unit 212Acreating a composite image by replacing those portions of an image ofperson 202A captured at a primary position with more in-focus positionsof an image of person 202A captured by image capture unit 206A when lens204A was at the other position. In one implementation of the example,image construction unit 212A corrects for the motion between imagesusing conventional techniques if such correction is desired. In anotherimplementation of the example, motion correction is not used.

With reference again to FIG. 3A, method step 312A shows a determinationof whether an aggregate change in focus, relative to the primaryposition of method step 302A, has exceeded a maximum expected deviationof a lens. For example, even with a relatively poor quality lens, therewill typically be an upper manufacturing limit beyond which lens defectsare not expected to go (e.g., the lens has manufacturing criteria suchas a focal length of 5 mm+/−0.05 mm).

Referring again to FIGS. 2A, 4A and/or 5A, one specific example ofmethod step 312A (FIG. 3A) would be controller 208A comparing anaggregate movement in a defined direction against a pre-stored upperlimit deviation value. In an implementation of the example illustratedin FIG. 4A, if lens 204A has manufacturing criteria such as a focallength of 5 mm+/−0.05 mm, controller 208A will determine whether thetotal forward movement of the lens is greater than 0.05 mm relative tothe primary position. In an implementation of the example illustrated inFIG. 5A, if lens 204A has manufacturing criteria such as a focal lengthof 5 mm+/−0.05 mm, controller 208A will determine whether the totalrearward movement of the lens is greater than 0.05 mm relative to theprimary position.

With reference again to FIG. 3A, if the inquiry of method step 312Ayields a determination that the aggregate changes in focuses has met orexceeded the maximum expected deviation of the lens, the processproceeds to method step 314A. Method step 314A illustrates that thecurrent composite image (e.g., of method step 310A) is stored and/ordisplayed. One specific example of method step 314A would bestore/display unit 214A either storing or displaying the compositeimage.

Method step 316A shows the end of the process.

Returning to method step 312A, shown is that in the event that the upperlimit on lens tolerance has not been met or exceeded, the processproceeds to method step 306A and continues as described herein.

Referring now to FIG. 4A, depicted is a side-plan view of the system ofFIG. 2A wherein lens 204A has been moved in accordance with aspects ofthe process shown and described in relation to FIG. 3A. Lens 204A oflens system 200A is illustrated as having been moved to another positionforward of the primary position which gave rise to the five differentportions of image 100A shown and described in relation to FIGS. 1A and2A. Specifically, lens 204A of lens system 200A is illustrated asrepositioned such that fifth portion 108A of image 100A is right sizedand focused on an imaging surface of photo-detector array 102A (e.g., asshown and described in relation to method step 306A). In oneimplementation, fifth portion 108A of image 100A can be combined withpreviously captured in focus and right sized portions 106A (e.g., FIGS.1A and 2A) to create a composite image such that the defects associatedwith fifth portion 108A as shown and described in relation to FIGS. 1Aand 2A are alleviated (e.g., as shown and described in relation tomethod step 310A). The remaining components and control aspects of thevarious parts of FIG. 4A function as described elsewhere herein.

With reference now to FIG. 5A, illustrated is another side-plan view ofthe system of FIG. 2A wherein lens 204A has been moved in accordancewith aspects of the process shown and described in relation to FIG. 3A.Lens 204A of lens system 200A is illustrated as having been moved toanother position rearward of the primary position which gave rise to thefive different portions of image 100A shown and described in relation toFIG. 1A. Specifically, lens 204A of lens system 200A is illustrated aspositioned such that first portion 104A of image 100A is right sized andfocused on an imaging surface of photo-detector array 102A (e.g., asdescribed in relation to method step 306A). In one implementation, firstportion 104A of image 100A can be combined with previously captured infocus and right sized portions 106A, 108A (e.g., FIGS. 1A, 2A, and 4A)to create a composite image such that the defects associated with firstportion 104A as shown and described in relation to FIGS. 1A and 2A arealleviated (e.g., as shown and described in relation to method step310A). The remaining components and control aspects of the various partsof FIG. 5A function as described elsewhere herein.

III. Image Correction Using a Microlens Array as a Unit

With reference to the figures, and with reference now to FIG. 1B, shownis a front-plan view of image 100B of a person (e.g., person 202B ofFIG. 2B) projected onto photo-detector array 102B. Image 100B is shownas distorted due to defects in a microlens array through which image100B has been projected (e.g., microlens array 204B of lens system 200Bof FIG. 2B). First portion 104B of image 100B is illustrated as largeand blurry, which can occur when a microlens deviation causes firstportion 104B of image 100B to come to a focus in front of an imagingsurface of photo-detector array 102B. Second, third, and fourth portions106B of image 100B are illustrated as right sized, which can occur whenmicrolenses of the microlens array cause portions 106B to correctlyfocus on an imaging surface of photo-detector array 102B. Fifth portion108B of image 100B is shown as small and faint, which can occur when amicrolens deviation causes fifth portion 108B to come to a focus(virtual) behind an imaging surface of photo-detector array 102B. Inaddition, although not expressly shown, those having skill in the artwill appreciate that various microlens defects could also cause theimage to be distorted in x-y; those having skill in the art will alsoappreciate that different colored wavelengths of light can in and ofthemselves focus at different positions due to differences in refractionof the different colored wavelengths of light. In addition, although notexpressly shown herein, those having skill in the art will appreciatethat the subject matter disclosed herein may serve to remedymisfocusings/distortions arising from defects other than lens defects,such as, for example, defects in the imaging surface of photo-detectorarray 102B and/or defects in frames that hold microlens arrays.

Referring now to FIG. 2B, depicted is a side-plan view of lens system200B that can give rise to image 100B of FIG. 1B. Microlens array 204Bof lens system 200B is illustrated as located at a primary position andhaving microlens deviations that give rise to the five differentportions of image 100B shown and described in relation to FIG. 1B. Firstportion 104B of image 100B is illustrated as misfocused in front of animaging surface of photo-detector array 102B, where the misfocus is dueto a deviation of microlens 252B. Second, third, and fourth portions106B of image 100B are illustrated as respectively right sized andfocused by microlenses 250B, 254B, and 258B on an imaging surface ofphoto-detector array 102B. (It is recognized that in side plan view thehead and feet of person 202B would appear as lines; however, for sake ofclarity they are shown in profile in FIG. 2B to help orient the readerrelative to FIG. 1B.) Fifth portion 108B is shown as small and faint,and virtually misfocused behind an imaging surface of photo-detectorarray 102B, where the misfocus is due to a deviation of microlens 256B.In addition, although not expressly shown herein, those having skill inthe art will appreciate that the subject matter of FIG. 2B is alsoillustrative of those situations in which one or more individualphoto-detectors forming part of the imaging surface of photo-detectorarray 102B—rather than one or more microlenses of microlens array204B—deviate from one or more predefined positions by amounts such thatimage misfocuses/distortions arising from such deviations areunacceptable. That is, insofar as image misfocusing and/or distortioncould just as easily arise from photo-detector array 102B havingmispositioned photo-detectors as from microlens array 204B havingmispositioned/defective lenses, the subject matter disclosed herein mayserve to remedy misfocusings/distortions arising from defects in theimaging surface of photo-detector array 102B.

Continuing to refer to FIG. 2B, further shown are components that canserve as an environment for the process shown and described in relationto FIG. 3B. Specifically, controller 208B is depicted as controlling theposition of microlens array 204B of lens system 200B (e.g., via use of afeedback control subsystem). Image capture unit 206B is illustrated asreceiving image data from photo-detector array 102B and receivingcontrol signals from controller 208B. Image capture unit 206B is shownas transmitting captured image information to focus detection unit 210B.Focus detection unit 210B is depicted as transmitting focus data toimage construction unit 212B. Image construction unit 212B isillustrated as transmitting a composite image to image store/displayunit 214B.

With reference now to FIG. 3B, depicted is a high level logic flowchartof a process. Method step 300B shows the start of the process. Methodstep 302B depicts capturing a primary image with a microlens array at aprimary position, the microlens array having at least one microlensdeviation that exceeds a first tolerance from a target optical property.Examples of the array having at least one microlens deviation thatexceeds a first tolerance from a target optical property include (a)where at least one microlens position exceeds a first tolerance from atleast one defined microlens position, and (b) where at least onemicrolens of the microlens array has at least one focal length thatexceeds a first tolerance from a defined focal length (e.g., a microlensdeviation that would produce portion 108B of image 100B at some placebehind an imaging surface of photo-detector array 102B or a microlensdeviation that would produce portion 104B at some place in front of theimaging surface of photo-detector array 102B where the distance in frontor back of the imaging surface exceeds a defined tolerance distancewhere an image captured with the photo-detector array 102B is deemedacceptable). Specific instances of the foregoing include a microlens ofthe microlens array having at least one spherical aberration thatexceeds a first tolerance from a defined spherical aberration, and amicrolens of the microlens array having at least one cylindricalaberration that exceeds a first tolerance from a defined cylindricalaberration. Alternatively, the microlens array may have some combinationof microlenses having such defects. In one implementation, method step302B includes the sub-step of capturing the primary image at an averageprimary focal surface location of the microlens array (e.g., a definedfocal surface of the microlens array where an image would form if themicrolens array had no microlenses having aberrations outside aspecified tolerance). In another implementation, method step 302Bincludes the sub-step of capturing the primary image with aphoto-detector array at the average primary focal surface location ofthe microlens array (e.g., positioning the microlens array such that adefined focal surface of the lens coincides with an imaging surface of aphoto-detector array).

Referring again to FIG. 2B, one specific example of method step 302B(FIG. 3B) would be controller 208B directing lens system 200B toposition microlens array 204B at a primary position, and thereafterinstructing image capture unit 206B to capture an image fromphoto-detector array 102B.

With reference again to FIG. 3B, method step 304B illustratesdetermining at least one out-of-focus region of the primary image (ordetermining at least one focused region of the primary image). In oneimplementation, method step 304B includes the sub-step of calculating aFourier transform of at least a part of the primary image (e.g., sharp,or in-focus images produce abrupt transitions that often havesignificant high frequency components).

Referring again to FIG. 2B, one specific example of method step 304B(FIG. 3B) would be focus detection unit 210B performing a Fouriertransform and subsequent analysis on at least a part of an imagecaptured by image capture unit 206B when lens 204B was at the primaryposition. In this example, focus detection unit 210B could deem portionsof the image having significant high frequency components as “in focus”images. As a more specific example, the Fourier transform and analysismay be performed on one or more parts of the image that are associatedwith one or more microlenses 250B-258B of microlens array 204B.

With reference again to FIG. 3B, method step 306B shows capturinganother image with the microlens array at another position. In oneimplementation, method step 306B includes the sub-step of capturing theother image at the average primary focal surface location of themicrolens array at the primary position. In another implementation, thestep of capturing the other image at a primary focal surface location ofthe microlens array at the primary position further includes thesub-step of moving at least a part of the microlens array to the otherposition; and capturing the other image with a photo-detector array atthe primary focal surface location of the microlens at the primaryposition (e.g., microlens array 204B is moved to another position, whilephoto-detector array 102B remains stationary, such as shown anddescribed in relation to FIGS. 4B and 5B). In another implementation,the step of moving at least a part of the microlens array to the otherposition further includes the sub-step of moving the at least a part ofthe microlens array to the other position within at least one distanceconstrained by a predefined variation from at least one definedmicrolens position. In another implementation, the step of moving atleast a part of the microlens array to the other position furtherincludes the sub-step of moving an intermediary lens. In anotherimplementation, the step of moving at least a part of the microlensarray to the other position further includes the sub-step of distortingthe microlens array such that the at least a part of the microlens arrayresides at the other position (e.g., a part of microlens array 204B ismoved to another position, such as might happen if microlens array 204Bwere to be compressed laterally in a controlled manner, whilephoto-detector array 102B remains stationary, such as shown anddescribed in relation to FIGS. 4B and 5B).

Referring now to FIGS. 2B, 4B and/or 5B, one specific example of methodstep 306B (FIG. 3B) would be controller 208B directing lens system 200Bto position microlens array 204B at a position other than the primaryposition and thereafter instructing image capture unit 206B to capturean image from photo-detector array 102B. FIG. 4B shows and describesmoving at least a portion of microlens array 204B forward of the primaryposition (e.g., such as by controller 208B moving microlens array 204Bforward, or causing microlens array 204B to be compressed such that apart of microlens array 204B moves forward relative to an imagingsurface of photo-detector array 102B). FIG. 5B shows and describesmoving at least a portion of the microlens array rearward of the primaryposition (e.g., such as by controller 208B moving microlens array 204Brearward, or causing microlens array 204B to be compressed such that apart of microlens array 204B moves rearward relative to an imagingsurface of photo-detector array 102B).

With reference again to FIG. 3B, method step 308B depicts determining afocus of at least one region of the other image relative to a focus ofthe at least one out-of-focus region of the primary image. In oneimplementation, method step 308B includes the sub-step of calculating aFourier transform of at least a part of at least one region of the otherimage (e.g., sharp or in-focus images produce abrupt transitions thatoften have significant high frequency components). In oneimplementation, the step of calculating a Fourier transform of at leasta part of at least one region of the other image (e.g., sharp orin-focus images produce abrupt transitions that often have significanthigh frequency components) includes the sub-step of mapping at least oneregion of the primary image with at least one region of the other image(e.g., mapping an out-of-focus region of the first image to acorresponding region of the second image). As a more specific example,the Fourier transform and analysis may be performed on one or more partsof the image that are associated with one or more microlenses of themicrolens array (e.g., mapping at least one region of the primary imageassociated with at least one specific microlens against the at least oneregion of the other image associated with the at least one specificmicrolens).

Referring again to FIGS. 2B, 4B and/or 5B, one specific example ofmethod step 308B (FIG. 3B) would be focus detection unit 210B performinga Fourier transform and subsequent analysis on at least a part of animage captured by image capture unit 206B when microlens array 204B wasat the other position specified by controller 208B.

With reference again to FIG. 3B, method step 310B depicts constructing acomposite image in response to the at least one region of the otherimage having a sharper focus relative to the focus of the at least oneout-of-focus region of the primary image. In one implementation, thestep of constructing a composite image in response to the at least oneregion of the other image having a sharper focus relative to the focusof the at least one out-of-focus region of the primary image includesthe sub-step of replacing at least a part of the out-of-focus region ofthe primary image with at least a part of the at least one region of theother image. In yet another implementation, the step of constructing acomposite image in response to the at least one region of the otherimage having a sharper focus relative to the focus of the at least oneout-of-focus region of the primary image includes the sub-step ofutilizing at least one of tiling image processing techniques, morphingimage processing techniques, blending image processing techniques, andstitching image processing techniques.

In yet another implementation, the step of constructing a compositeimage in response to the at least one region of the other image having asharper focus relative to the focus of the at least one out-of-focusregion of the primary image includes the sub-steps of correlating afeature of the primary image with a feature of the other image;detecting at least one of size, color, and displacement distortion of atleast one of the primary image and the other image; correcting thedetected at least one of size, color, and displacement distortion of theat least one of the primary image and the other image; and assemblingthe composite image using the corrected distortion. In yet anotherimplementation, the step of constructing a composite image in responseto the at least one region of the other image having a sharper focusrelative to the focus of the at least one out-of-focus region of theprimary image includes the sub-step of correcting for motion between theprimary and the other image.

Referring again to FIGS. 2B, 4B and/or 5B, one specific example ofmethod step 310B (FIG. 3B) would be image construction unit 212Bcreating a composite image by replacing those portions of an image ofperson 202B captured at a primary position with more in-focus portionsof an image of person 202B captured by image capture unit 206B whenmicrolens array 204B was at the other position. In one implementation ofthe example, image construction unit 212B corrects for the motionbetween images using conventional techniques if such correction isdesired. In another implementation of the example, motion correction isnot used.

With reference again to FIG. 3B, method step 312B shows a determinationof whether an aggregate change in position, relative to the primaryposition of method step 302B, has exceeded a maximum expected deviationof the microlens array. For example, even with a relatively poor qualitymicrolens array, there will typically be an upper manufacturing limitbeyond which microlens deviations are not expected to go (e.g., themicrolens array has manufacturing criteria such that each microlens inthe array provide a focal length of 5 mm+/−0.05 mm).

Referring again to FIGS. 2B, 4B and/or 5B, one specific example ofmethod step 312B (FIG. 3B) would be controller 208B comparing anaggregate movement in a defined direction against a pre-stored upperlimit deviation value. In an implementation of the example illustratedin FIG. 4B, if microlens array 204B has manufacturing criteria such as afocal length of 5 mm+/−0.05 mm, controller 208B will determine whetherthe total forward movement of the microlens array is greater than 0.05mm relative to the primary position. In an implementation of the exampleillustrated in FIG. 5B, if microlens array 204B has manufacturingcriteria such as a focal length of 5 mm+/−0.05 mm, controller 208B willdetermine whether the total rearward movement of microlens array 204B isgreater than 0.05 mm relative to the primary position.

With reference again to FIG. 3B, if the inquiry of method step 312Byields a determination that the aggregate change in position has met orexceeded the maximum expected deviation of the microlens array, theprocess proceeds to method step 314B. Method step 314B illustrates thatthe current composite image (e.g., of method step 310B) is stored and/ordisplayed. One specific example of method step 314B would be imagestore/display unit 214B either storing or displaying the compositeimage.

Method step 316B shows the end of the process.

Returning to method step 312B, shown is that in the event that the upperlimit on microlens array tolerance has not been met or exceeded, theprocess proceeds to method step 306B and continues as described herein.

Referring now to FIG. 4B, depicted is a side-plan view of the system ofFIG. 2B wherein microlens array 204B has been moved in accordance withaspects of the process shown and described in relation to FIG. 3B.Microlens array 204B of lens system 200B is illustrated as having beenmoved to another position forward of the primary position which gaverise to the five different portions of image 100B shown and described inrelation to FIGS. 1B and 2B. Specifically, microlens array 204B of lenssystem 200B is illustrated as repositioned such that fifth portion 108Bof image 100B is right sized and focused on an imaging surface ofphoto-detector array 102B (e.g., as shown and described in relation tomethod step 306B). In one implementation, fifth portion 108B of image100B can be combined with previously captured in focus and right sizedportions 106B (e.g., FIGS. 1B and 2B) to create a composite image suchthat the defects associated with fifth portion 108 as shown anddescribed in relation to FIGS. 1B and 2B are alleviated (e.g., as shownand described in relation to method step 310B). The remaining componentsand control aspects of the various parts of FIG. 4B function asdescribed elsewhere herein.

With reference now to FIG. 5B, illustrated is another side-plan view ofthe system of FIG. 2B wherein microlens array 204B has been moved inaccordance with aspects of the process shown and described in relationto FIG. 3B. Microlens array 204B of lens system 200 is illustrated ashaving been moved to another position rearward of the primary positionwhich gave rise to the five different portions of image 100B shown anddescribed in relation to FIG. 1B. Specifically, microlens array 204B oflens system 200B is illustrated as positioned such that first portion104B of image 100B is right sized and focused on an imaging surface ofphoto-detector array 102B (e.g., as described in relation to method step306B). In one implementation, first portion 104B of image 100B can becombined with previously captured in focus and right sized portions106B, 108B (e.g., FIGS. 1B, 2B, and 4B) to create a composite image suchthat the defects associated with first portion 104B as shown anddescribed in relation to FIGS. 1B and 2B are alleviated (e.g., as shownand described in relation to method step 310B). The remaining componentsand control aspects of the various parts of FIG. 5B function asdescribed elsewhere herein.

1.-50. (canceled)
 51. A method comprising: capturing a primary imagewith a lens at a primary position, the lens having at least onedeviation that exceeds a first tolerance from a target optical property;capturing another image with the lens at another position; determiningat least one out-of-focus region of the primary image; determining afocus of at least one region of the other image relative to a focus ofthe at least one out-of-focus region of the primary image; andconstructing a composite image in response to the at least one region ofthe other image having a sharper focus relative to the focus of the atleast one out-of-focus region of the primary image. 52.-68. (canceled)69. A system comprising: a lens having at least one deviation thatexceeds a first tolerance from a target optical property; means forcapturing a primary image with a lens at a primary position; means forcapturing another image with the lens at another position; means fordetermining at least one out-of-focus region of the primary image; meansfor determining a focus of at least one region of the other imagerelative to a focus of the at least one out-of-focus region of theprimary image; and means for constructing a composite image in responseto the at least one region of the other image having a sharper focusrelative to the focus of the at least one out-of-focus region of theprimary image.
 70. The system of claim 69, wherein said lens having atleast one deviation that exceeds a first tolerance from a target opticalproperty further comprises: the lens having at least one focal lengththat exceeds a first tolerance from a defined focal length.
 71. Thesystem of claim 69, wherein said lens having at least one deviation thatexceeds a first tolerance from a target optical property furthercomprises: the lens having at least one spherical aberration thatexceeds a first tolerance from a defined spherical aberration.
 72. Thesystem of claim 69, wherein said lens having at least one deviation thatexceeds a first tolerance from a target optical property furthercomprises: the lens having at least one cylindrical aberration thatexceeds a first tolerance from a defined cylindrical aberration.
 73. Thesystem of claim 69, wherein said means for capturing a primary imagewith a lens at a primary position further comprises: means for capturingthe primary image at a primary focal surface location of the lens. 74.The system of claim 73, wherein said means for capturing the primaryimage at a primary focal surface location of the lens further comprises:means for capturing the primary image with a photo-detector array at theprimary focal surface location of the lens.
 75. The system of claim 69,wherein said means for capturing another image with the lens at anotherposition further comprises: means for capturing the other image at aprimary focal surface location of the lens at the primary position. 76.The system of claim 75, wherein said means for capturing the other imageat a primary focal surface location of the lens at the primary positionfurther comprises: means for moving at least a part of the lens to theother position; and capturing the other image with a photo-detectorarray at the primary focal surface location of the lens at the primaryposition.
 77. The system of claim 76, wherein said means for moving atleast a part of the lens to the other position further comprises: meansfor moving the at least a part of the lens to the other position withinat least one distance constrained by the first tolerance from the targetoptical property.
 78. The system of claim 76, wherein said means formoving at least a part of the lens to the other position furthercomprises: means for moving an intermediary lens.
 79. The system ofclaim 76, wherein said means for moving at least a part of the lens tothe other position further comprises: means for distorting the lens suchthat the at least a part of the lens resides at the other position. 80.The system of claim 69, wherein said means for determining at least oneout-of-focus region of the primary image further comprises: means forcalculating a Fourier transform of at least a part of the primary image.81. The system of claim 69, wherein said means for determining a focusof at least one region of the other image relative to a focus of the atleast one out-of-focus region of the primary image further comprises:means for calculating a Fourier transform of at least a part of the atleast one region of the other image.
 82. The system of claim 81, whereinsaid means for calculating a Fourier transform of at least a part of theat least one region of the other image further comprises: means formapping at least one region of the primary image with at least oneregion of the other image.
 83. The system of claim 69, wherein saidmeans for constructing a composite image in response to the at least oneregion of the other image having a sharper focus relative to the focusof the at least one out-of-focus region of the primary image furthercomprises: means for replacing at least a part of the out-of-focusregion of the primary image with at least a part of the at least oneregion of the other image.
 84. The system of claim 83, wherein saidmeans for replacing at least a part of the out-of-focus region of theprimary image with at least a part of the at least one region of theother image further comprises: means for utilizing at least one oftiling image processing techniques, morphing image processingtechniques, blending image processing techniques, and stitching imageprocessing techniques.
 85. The system of claim 69, wherein said meansfor constructing a composite image in response to the at least oneregion of the other image having a sharper focus relative to the focusof the at least one out-of-focus region of the primary image furthercomprises: means for correlating a feature of the primary image with afeature of the other image; means for detecting at least one of size,color, and displacement distortion of at least one of the primary imageand the other image; means for correcting the detected at least one ofsize, color, and displacement distortion of the at least one of theprimary image and the other image; and means for assembling thecomposite image using the corrected distortion.
 86. The system of claim69, wherein said means for constructing a composite image in response tothe at least one region of the other image having a sharper focusrelative to the focus of the at least one out-of-focus region of theprimary image further comprises: means for correcting for motion betweenthe primary and the other image.
 87. A system comprising: aphoto-detector array; a lens having at least one deviation that exceedsa first tolerance from a target optical property; a controllerconfigured to position said lens at a primary and another positionrelative to said photo-detector array and to cause an image capturesignal at the primary and the other position; and an image constructionunit configured to construct at least one out-of-focus region of a firstimage captured at the primary position with a more in-focus region ofanother image captured at the other position. 88.-90. (canceled)
 91. Thesystem of claim 87, wherein said image construction unit configured toconstruct at least one out-of-focus region of a first image captured atthe primary position with a more in-focus region of another imagecaptured at the other position further comprises: circuitry forconstructing at least one out-of-focus region of a first image capturedat the primary position with a more in-focus region of another imagecaptured at the other position said circuitry including at least one ofelectrical circuitry having at least one discrete electrical circuit,electrical circuitry having at least one integrated circuit, electricalcircuitry having at least one application specific integrated circuit,electrical circuitry having a general purpose computing deviceconfigured by a computer program, electrical circuitry having a memorydevice, and electrical circuitry having a communications device.92.-144. (canceled)